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We discuss a general formalism that allows study of transitions over barriers in spin glasses with 
long-range interactions that contain large but finite number, A'^, of spins. We apply this formalism 
to the Sherrington-Kirkpatrick model with finite A'^ and derive equations for the dynamical order 
parameters which allow "instanton" solutions describing transitions over the barriers separating 
metastable states. Specifically, we study these equations for a glass state that was obtained in 
a slow cooling process ending a little below Tc and show that these equations allow "instanton" 
solutions which erase the response of the glass to the perturbations applied during the slow cooling 
process. The corresponding action of these solutions gives the energy of the barriers, we find that 
it scales as where r is the reduced temperature. 



The most prominent feature of a glass state of mat- 
ter is the existence of an extensive number of metastable 
states separated by large energy barriers. This feature is 
reproduced in many infinite range models which allow a 
mean field treatment; in the framework of this mean field 
approach the properties of these states have been stud- 
ied extensively over the last 20 years and a very detailed 
picture has emerged Originally, the models studied 
were thought to describe only systems with frozen disor- 
der, like spin glasses, but more recently it was realized 
that similar methods can be applied to frustrated sys- 
tems without quenched disorder that may be viewed as 
analogues of ordinary glasses . 

Empirically, the existence of the extensive number of 
states is revealed in a very slow dynamics of the glass 
phase that is referred to as creep or ageing; this slow dy- 
namics is usually attributed to transitions between dif- 
ferent metastable states. Although, as a result of this ex- 
tensive theoretical work mentioned above, the properties 
of the individual states are well understood, transitions 
between these states have been deprived of due atten- 
tion. In this Letter we propose an analytical approach 
to address this problem; we apply it to the Sherrington- 
Kirkpatrick model Q and derive integral equations which 
describe the transitions between metastable states. We 
were not able to solve these equations analytically but 
we can show numerically that they admit a solution with 
expected qualitative properties. Our results have two 
applications: firstly, we hope that most qualitative fea- 
tures of the barrier distribution found in the infinite range 
models will hold in the finite range physical glasses, and 
secondly, it seems possible to test the predictions of the 
infinite range models on purpose built Josephson arrays 
1^ ; in the latter systems the number of effective "spins" , 
N , is large {N ~ 100 — 300) but not infinite and our 
results should be directly applicable. 

Specifically, we shall consider a dynamical version of 
the Sherrington-Kirkpatrick model with N soft spins that 



is characterized by the equations of motion 



H — ^ ^ J ij Si Sj ^ ^ Si hi 



Y.^{S^) 



(1) 

(2) 



Here Jy is a matrix of quenched random Gaussian cou- 
plings normalized by (Jfj) — ^/N, hi is an external 
magnetic field acting on spin i, (^(t) is random thermal 
noise with correlator {Ci{t)Cj{t')) = 2rQ^Sij5{t - t') and 
V[S) is a one spin potential that keeps {S'f) — 1; its 
exact form is irrelevant, but for example one can take 
V{S) = roiS^ - 1)2, with ro > T. 

It is well established that the low temperature state 
of this model is completely characterized by two or- 
der parameters: the correlation function, D(ti,t2) — 
{Si{ti)Si{t2)), and the response function, G(ti,i2) = 
( sh^-{tl) )- -'^^ ^^'^ ^"^^ temperature state both these func- 
tions acquire a part which is non-decaying in time [^; 
a particular feature of the glass phase is the appearance 
of a non-decaying contribution to the response function 
G{ti, t2), showing that a perturbation applied in the dis- 
tant past (at time ^2) continues to affect the present (at 
time ti). Furthermore, different sample histories lead- 
ing to the same final temperature and magnetic field 
would produce different order parameters, D{ti,t2) and 
G{ti,t2) 0,11 ; this is what one would expect in a system 
that can be trapped in any of many metastable states 
and where the state where it is trapped is determined 
by the thermal history. So, in order to specify the glass 
state one needs to specify the history of the sample that 
led to this state. In the following we shall consider the 
systems prepared by the slow cooling process in which 
the temperature is varied slowly compared to the spin 
flip rate, Fq. In this regime it is convenient to sepa- 
rate the correlation and response functions into "fast" 
and "slow" parts: D{ti,t2) = -D/(ii, ^2) + 9(^1, ^2) and 
G{ti,t2) = Gf{ti,t2) + A{ti,t2)- The order parameters 
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characterizing the state of the model at the end of a 
monotonic slow cooling process ending at T{ti) = Ti 
are well known if the reduced temperature is small, 
{Tc-T)/T,^T ^ 1: 



gti.f2 = min(Ti, r2) + O(t^) 



(3) 



Sqt 



n - qt.t 



Here and in the following we denote ri = t(<i). This form 
of A{ti,t2) shows that any perturbation applied during 
the cooling process has everlasting effects; this is natu- 
ral since qualitatively each state continuously subdivides 
during the cooling process and no transitions between 
these states are possible within the framework of this ap- 
proach which becomes exact at ^ cxo and ^ ^ 0. 
Empirically, we expect that at finite N these transitions 
become allowed the response function A{ti,t2) decays 
and eventually the memory of a perturbation applied at 
a past time is lost. Furthermore, we expect that barriers 
formed between states with larger overlap are generally 
smaller than the barriers between states with small over- 
lap and that transitions between the former are there- 
fore more likely to occur. States with large overlaps are 
formed at later stages of a cooling process as a subdivi- 
sion of the ancestor state, so we expect that the lowest 
barriers would correspond to the transitions which de- 
stroy only the memory of a recent past. 

In fact, as we shall show below, a theory in terms 
of only q and A is insufficient to describe transitions 
over the barriers and we need to introduce one more or- 
der function. We explain the general formalism using 
the simple example of a particle in a potential V{x) = 
vx'^(l — x) which is in the metastable state around x — 
at low temperatures T <ti v but might escape to a; = cxd 
with probability exTp{~Vmax/T). All correlation func- 
tions in this warm-up problem can be obtained from the 
dynamic equations of motion 



dx 
It 



dV_ 

dx 



+at), {amt')) = ^TS{t^t') (4) 



or, equivalently, from the generating functional 

Z = j VxVxeyip{~A{x,x] + Ah{x,x})J{x] (5) 
A{x, x} — J 



, dx dV , „ n 
ixi— + —) + Tx^ 
dt dx 



(6) 



where J{x} = det + ^^Y^ ^ is a Jacobean whose 
effects one can ignore to get the results with only an ex- 
ponential accuracy and Ah{x, x} are source terms, e.g. in 
order to get correlators of x one can use Ah{x, x} = hx, 
then (x*^) = 7f^- small temperatures the functional 
integral in (|^) is dominated by the saddle point solutions. 
Varying the action A{x} with respect to x and x we get 



dx 
dt 
dx 
dt 



d^V f 
Hx^" 
dV _ 

dx 



= 
2iTx 



(7) 



These equations admit two dramatically different solu- 
tions. In the first solution x = 0, ^ — correspond- 
ing to a particle that slides down the potential hill prac- 
tically unaffected by the thermal noise; this solution has 
zero action. The second solution is iTx — ^ = 
corresponding to the particle going up the hill instead of 
down; it can be obtained from the first solution by in- 
verting the sign of the time so that the response of this 
particle to an external field is anti-causal. Within the 
saddle point approximation the path of the particle es- 
caping the metastable state at a; = consists of the latter 
solution for < x < Xmax and the former for x > Xmax 
(here Xmax is the point where potential has a maximum); 
the action associated with this path is A = (36V, so it 
has probability exp{—(3SV), reproducing, as it should, 
the Boltzmann formula. Note that the general statement 
that the correlator (xx) — does not prevent one from 
having this "instanton" solution with a finite conjugate 
field. Note also that once the solutions with this field 
non-zero are allowed, the action corresponding to these 
solutions is no longer zero but this does not contradict 
the general statement that Z = 1 in the absence of source 
terms in because Jacobean contribution cancels the 
contribution of these solutions in the absence of source 
terms. As a more detailed study shows in the presence 
of the source terms Jacobean contribution does not af- 
fect the leading exponential factor and that therefore the 
simple analysis (like the one above) that ignores source 
terms and the effects of Jacobean gives correct result for 
correlators. In what follows we shall assume that this 
conclusion is also true for the glass problem and ignore 
the effects of Jacobean and of the source terms. 

A similar generating functional procedure with ex- 
tremal analysis is conveniently employed to discuss the 
spin glass models of Eqs. (|^) and (|^). By analogy with 
above simple example we expect that saddle point solu- 
tions corresponding to transitions over the barriers ex- 
ist also in the glass model if the fields conjugate to the 
variables D{ti,t2) and G(<i,i2) are allowed to acquire 
non-zero values. So, we have to repeat the derivation 
of the equations for the order parameters without mak- 
ing the usual assumption that the variables conjugated 
to D{ti,t2) and G{ti,t2) are zero. The first steps of the 
derivation are not changed; these steps are explained well 
in the literature |]6|-^,|l0|, so we only recall them here. 
The dynamics (|l]) is reproduced by the generating func- 
tional Z = J VSVSVxVxeiip{~AB{S,S} - Af{x,x}) 
where S, S and Ab{S,S} are analogous of x, x and 
A{x, x} and additional integrals over fcrmionic fields x, x 
reproduce the Jacobean. To simplify the notations it is 
very convenient to introduce, following Kurchan | pO{ , su- 
percoordinates 9 and 9 that allow one to write the action 
in terms of the superfield (f>{9, 9) = S + 9x + 9x + 99S. 
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In these compact notations the full action »4{(/)} can be 
represented as a sum of a single spin part, and in- 
teracting part, Aint = i^^i j Jij^'ii'ji the latter being 
the only term containing the couplings Jy. This action 
is linear in the coupling Jij, allowing one to average the 
generating functional over the Gaussian distribution of 
Jij. This results in a four 'spin' interaction which one 
can decouple by a symmetric superfield Qt^^t^ (here and 
below we use notation T to denote the set of variables 
{t, 0, As can be shown |^ in the illustrative exam- 
ple discussed in the last paragraph, we assume that the 
fermionic contribution can be ignored in a study to lead- 
ing (exponential) order, so we retain only Bose compo- 
nents of the order parameter field Qti.T2 ■ 



Ti.r^ ~ ^ti:*2 + Gti,t26262 + Gti,t26i6i- 



(8) 



The symmetry QT1.T2 = QT2.T1 implies that fimctions 
Ai,t2 and t2 are symmetric and that Gj^.ta — Gj2,ti, 
so Gt2,ti is a backward response. The next technical step 
is to integrate out the spin variables which are now de- 
coupled and get the effective action of the field Q{Ti, T2): 



Z = 
A = 



VQexp{-NA{Q}) 
J \pt^Ql,.T,Pt2dTidT2 + As{Q} 



where 



As{Q} = -\n 



j I?0exp(-A{0}+ 



\ j Pt^Qr^,r2Mri)<p{r2)dTidr2) 



(9) 
(10) 

(11) 

(12) 



is the effective action of Q generated by decoupled spin 
degrees of freedom, The large factor N in front of the 
action in Eq. (||) allows one to look only for the saddle 
point solutions which are obtained by varying the action 
with respect to Q or, more explicitly, with respect to its 
components D, D and G. The solution with zero action 
corresponds to the usual choice Dt^^t2 = 0; Gt2,ti = at 
ti > t2\ but neither of these relations necessarily holds 
for the saddle point solution with non-zero action that 
we are looking for. As we shall show explicitly below, if 
these conditions are imposed the usual solutions for the 
response functions of the glassy state are recovered. We 
shall of course need an explicit form of As{Q}\ in the 
general case this action is very complicated, so to sim- 
plify we shall consider only the vicinity of the transition 
temperature (r <^ 1) and keep only the terms which af- 
fect the long time dynamics at such temperatures. Fur- 
thermore, we shall keep only the leading terms in the 
expansion in the conjugate order parameters -Dti.ta and 
Gti<t2 because, as we shall show below, transitions over 



small barriers (which, of course, dominate) involve only 
small values of these quantities. 

Below we shall use a diagram expansion to derive the 
full saddle point equations following from the action (|l^) . 
However, before we embark on it, it is instructive to do 
a preliminary analytic calculation assuming that one can 
keep only quadratic terms in the action Aq{4>}. The re- 
sults of this calculation can not be used below Tc, because 
there non-linear terms are essential but this derivation 
is much simpler and gives correctly all terms of the full 
equations except one thereby providing a useful reference 
point. In this approximation all integrals over (p in ( p^ ) 
are Gaussian and can be performed explicitly, so As be- 



As = STiMQo^ - I3^Q) 



(13) 



where STr denotes integral over times and trace over su- 
persymmetric variables, Q are understood as operators 
and Qo = {^iTi)(l>iT2)). Explicitly q[,^) = ..^ + 
G°t,, 12^262 + G°^^t/i0i. Here Go and Dq are single 
site spin response and correlation functions which con- 
tain all local effects. Inverting Qq we get (Qq^')^^ = 
HGo]Do)t,.,^iGo%^,/262HGo%M^~iOi, next we 
insert it into (|l3[) and rewrite it in a more explicit form: 



As 



- In det 
2 



Gn 



/3'G) 



Finally, as we shall see below, transitions over the bar- 
riers in the vicinity of Tc require only small noise fields 
D; this allows us to simplify the action further by ex- 
panding in D; retaining only the leading and subleading 
terms in it we get the simplified expression for the full 
action (F^: 



A = i/J^Tr 



GG + DD 



(14) 



D 



where G, D, D and H = (Gg^Do) + (3^D are understood 
as operators so that, e.g. TrGG= / dtidt2Gtit2Gt2ti- Be- 
low we shall get an equation for D by varying this action 
with respect to Z?, so to get the leading and subleading 
terms in this equation we shall need to keep also terms 
up to quadratic order in D: 



A = i/3'Tr 



GG + DD 



TrlnfGn 



/3'G) 



(15) 



^/3^Tr [Go-i - P'G] ' H [(G^-^ - (i^G)^] D - 
{ [Go 1 - P^G] ' H [(Go 1 - /?2G)t] ' d}' 



Varying action (|15|) with respect to G, D and D fields 
and keeping only the leading and subleading terms in D 
we get equations 
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G= (Gpi -/S^G)" +GnG^£)G 
D = GHGt - GnG^i3GnGt 
D = G^DG - G^DGUG^DG 



(16) 
(17) 
(18) 



Here we have dropped the factors of /3 in the sublead- 
ing terms in D, ignoring their dependence on t = Tc — T 
because these terms are already small in r as explained 
above; we simplified the second terms in all the equa- 
tions noting that they are already of the next order in 
D, which allows us to substitute [Gq^ — /3^G] « G 
in these terms; finally, wc have also simplified the second 
and the third equations using the first equation to express 
(Gg^ — P^G) via G. These equations are analogues of 
the equations (^ for the toy model. At D — this system 
of equations reduces to the equations derived in ||^ for 
the glass dynamics above Tc, leading to the response and 
correlation functions that satisfy fluctuation-dissipation 
theorem (FDT). As was shown in |^ the quadratic ap- 
proximation to the local spin response is sufhcient above 
Tc so in this temperature range the equations ( |l6| - |l^ ) are 
correct. However, in this temperature range there are no 
barriers and so for our present purpose these equations 
are not very interesting either. To finish our discussion 
of the equations for T > Tc we give the final formula 
for the action expressed via the solutions G, D and D 
of the equations ( p^[]l8| ) which are simplified by making 
the same approximations as we did in deriving equations 
(HH): 



A 



GG + DD 



+ Tr\n{Go^ - P^G) 



(19) 



^P^TtGHG^D + ^P^Tt |GHGti3|' 



Note that because we have already used the equations 
( p^fjl^ ) to simplify the action the solutions of these equa- 
tion do not necessarily minimize the action (|l9|). 

We now derive the full equations below Tc where non- 
linearity of the action ^o{'/'} becomes essential [||, em- 
ploying a diagram technique. To construct this technique 
we note that the saddle point equations can be rewrit- 
ten in the form Ai.ts = {StiSt2)s, Ai,t2 = {StiSt2)s 
and Gtj_t2 — {St-iSt2)s where {■■■)s denotes the aver- 
age over a single spin variable taken with the weight 
exp(-A{0} + / Qr^,rA{Tl)(t){r2)dTldr2). We shaU use 
a formal expansion in the term J QT-i,T24>{Ti)4>{T2)dTidT2 
to derive equations for the correlation and response func- 
tions and then reconstruct the action that gives them; 
furthermore, as above, we shall keep only the leading 
and subleading terms in D in these equations. 

The known form of the equations for -Dt^.tj and 

Gti>t2 — the case when DtiM — ^ ^'^'^ Gti^t2 = 
allows us to reconstruct all the terms in the action A that 
are linear in the conjugate fields. We shall go briefly over 
the derivation of these equations because later it will al- 



low us more easily to explain how to augment these equa- 
tions for non-zero conjugate flelds and construct the full 
action. 

We start with the equation for the response function 
G at D = 0. In this approximation G satisfies the Dyson 
equation diagrammtically represented as shown in Figs 
la and Fig lb, the first of these contributions sufficing 
to reproduce the correct dynamics above Tc and equiv- 
alent to (|l^) at I? = while the second is needed to 
reproduce replica symmetry breaking effects in thermo- 
dynamics and memory effects in the correct dynamical 
solution llJIQ- Together they yield 



G== [G^^ - pGp-?,y{GD''-)\ 



(20) 



which leads to the conventional equation for the dynam- 
ics below Tc and eventually to the result (^) . Here and be- 
low inversion should be understood as operator inversion, 
PGP stands for Pt^Gt^^t2Pt2i Go is the bare local spin re- 
sponse function and we use parenthesis () to imply the 
usual (arithmetic) product of two functions as opposed to 
the operator product implied everywhere else. The exact 
form of Gq ^ is not important, because we need only its 
low frequency asymptote for which we assume a general 
form Go(w)~^ = a — iuT where a is the renormalized 
zero frequency response and F is a renormalized relax- 
ation rate; these renormalizations are due to high energy 
processes and are not singular. Finally, the coefficient 
y describes the strength of a local four spin correlator, 
in the following we shall take the value y = 2/3 corre- 
sponding to the hard Ising spins P,|8|,|l0t , but note that 
this value can be always reduced to unity by scaling the 
correlation functions in the final slow cooling equations, 
so it is not important for the qualitative properties of the 
solutions. The factor 3 in front of the subleading term 
in Eq. ( pO[ ) is a combinatorial factor associated with the 
self energy diagram, it appears because two intermediate 
propagators in it are Ds and only one is G; note that 
it does not appear in the corresponding diagram for D 
where all intermediate propagators are Ds. A non-zero 
conjugate field D gives a new contribution to the equa- 
tion for G. Diagrammatically this is as shown in Fig. 
la, lb (terms giving Eq. (pO[)) and Fig. Ic (new term). 
Combining and manipulating these terms leads to 



G^G + GHG^LiG 

G = [Go' ~ PGP - SyiD^G)] 

H = Go^Do + pop + y{D'') 



(21) 
(22) 
(23) 



where we have dropped factors of /3 « 1 in the terms 
subleading in D because the corrections are small in the 
vicinity of Tc and have replaced G by G in the second 
term because the difference between these is 0{D). 

The equation for the correlation function Dt^^t2 in the 
leading approximation in D is shown in Fig. Id; in anal- 
ogy with the equation for the response function shown 
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in Fig la we keep here only the leading and subleading 
terms in the self energy. This equation together with 
the equation for G yields the full system of equations for 
the dynamics of the spin glass below the transition tem- 
perature in the absence of transitions over the barriers; 
the adiabatic approximation to these equations was dis- 
cussed in e.g. 1^,^. The graphical representation of the 
subleading term in D is shown in Fig. le; it is analogous 
to the subleading term in the equation ( p^ ) obtained in 
the quadratic approximation. Combining these terms we 
get 



D = GHGt + GUG^IDGHG'' 



(24) 



Again, to the order required we may replace G by G in 
the second term. A further simplifiaction results from 
using to express G via G in the first term yielding 



D = GHGt - GUG^DGUG'' 



(25) 



Finally, the equation for D follows from the summation 
of the diagrams shown in Fig. If and Fig. Ig; note that 
here we have two contributions to the subleading part 
that graphically differ by the directions of the arrows in- 
side the self energy term: 



5 = Gt \l3Df3 + 3y{D^D) + &y{GG^ D) 
-G^ DGUG^ DG 



G 



(26) 



Here, as above, we have simplified the final expression us- 
ing equations (|^) to express G via G in the first term, re- 
placed G by G in the second term and neglected factors of 
/3 « 1 and terms proportional to y (D^D) + {GGW) D 
because all these effects are small in the vicinity of Tc- 

Equations (|2l|-p6|) form the full system of equations 
describing dynamics of the spin glass below Tc, it dif- 
fers from the system ( |l6[]l^ ) (that can be used above Tc) 
only by the terms proportional to y which describe the 
strength of the local non-linear spin response. The ac- 
tion corresponding to the system of equations ( ^l| - |2^ ) is 
rather cumbersome, so we shall not write it here. Instead 
we shall first further simplify these equations by assum- 
ing that all fields change adiabatically slowly, i.e. that 
the time scale at which they change is much longer than 
the spin fiip time scale F"^. In this approximation the 
fast part of the Green function can be replaced by a delta- 
function, so we get GtiA2 ~ ^ ^h) + '^ti,t2- We 
shall simplify these equations even more by keeping only 
the leading terms in the reduced temperature r and using 
the fact that t — q = Sq = 0{t'^). To prove this general 
statement consider, say, equation ( p5| ) at ti — t2 ^ Fq ^ 
and keep only the terms of the order of t^. The sec- 
ond term in this equation is at least of the order of 
and can be ignored completely. Moreover in the approx- 
imation one can replace Gt^^tj — > (1 — q)d{ti — ^2) and 



H j3Dj3 in the first term. Collecting the remaining 
terms we get (r — q)Dt^^t2 = O(t^), so the existence of a 
non-zero -Dti,t2 — QtiM = 0{q) implies that Sq = O(r^). 
The remaining two equations are also satisfied to the or- 
der of if (r — q)Dti^t2 = 0{t^), so one gets non-trivial 
equations keeping only the terms of the order of t^: 



(27) 
(28) 



{Sqt, +Sqt2 +3yqf^^t2)^U,t2 + 
J{At,,t^t,t2+qtutDt,t2)dt = 

{6qt, +5qt2 +yqt,,t2)ltut2 + J qtiA^t2.idt+ 
f qt2^tAt,^t - J qt,A'Dt'A"qt"Adt'dt" = 

{Sqt, +6qt2 +3yqf^^t2)^U,t2 + 

J Dt,,tAt,t2dt+J Dt,t2\t^dt+ ^ (29) 
6yqti^t2^ti,t2^t2,ti - J Dt^^t'qt',t"Dt",tdt'dt" = 

Now we derive the simplified expression for the action 
that corresponds to the adiabatic and r <gc 1 approxima- 
tions used in deriving ( p7[]29| ) . First we note that the spin 
part of the action, ^5, is zero if D = 0, At-^<ct2 = 0; this 
can most easily be verified by inspecting the diagram- 
matic expansion for the action. In this representation 
As is given by the sum of closed diagrams which contain 
only G lines or contain at least one D line so at least 
one of the of the lines in any closed diagram is either 
Atj<(2 or D, therefore As = if both these functions 
are zero. Further, variational derivatives of the action 
with respect to the functions D and G give spin correla- 



tors, i.e. j3^sG 
Z) EE and 

SD 



G = [G^^ -PGP-?,y{D^G)] 



at 



so these 



GHGt + GHG^DGHGt 

two equations completely determine it. To simplify the 
action in the vicinity of the transition temperature we 
note that the part of the action which is zeroth order 
in D necessarily contains at least one advanced response 
function, Ga- As discussed above, we expect that in the 
vicinity of Tc such anomalous terms are small (because 
barriers are small) and so we can expand in D. Keeping 
at most terms of the second order in Ga and D we get 



As = -P^TtGaGr - ^Tr 

1 r 



GaGr 



(30) 



-Tr 



GUG'^D 



gug'^d 



Gr = [Gq-i - (3Gr(3 - SyiD^GR)] ' 

where in analogy with the derivation of the equations 
(^,|5|,|6|) we have neglected self energy corrections to 
the terms that are of the second order in Ga- The full 



action is ^ = As + 



T^GaGr 



^TiDD 



We can 



simplify this expression by replacing Gr and D in the 



term (3'^ 
tions (Ell 



^TtDD 



by the r.h.s of the equa- 



TrG^Gfl 

2^ ) . Keeping only the terms of the second order 
in Ga and D and retaining f3 only in the leading terms 
we get 
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GaGrUGbDGr 



1 



Tr 



Finally we assume that Ga and D are adiabatically slow 
and keep only the leading terms in t: 



^ = Tr 



AaAaAr + AaDq - ^qDqD 



(31) 



where = At,t,e{h - h) [Ar = At.tMi " ^2)) are 
advanced (retarded) parts of the adiabatic response. 

For the numerical solution of the equations ( p7|^9| ) it is 
convenient to regard them as the equations for the saddle 
point of the effective action 



A// = --^ J Ati^t2At2,t3At.^^tidtidt2dt3 



(32) 



{Sqt^ +&qt2 + yqti,t2'l1ti^t2Dt2Aidtidt2 - 
^ Ji^Qti +5qt2 + 3yqt^^t2)'^ti,t2At2,tidtidt2 

qti,t2^t2,t3^t3,tidtldt2dt^ + 



^ / qti,t2^t2,t3qH,t4,Dt4,,ti_dtldt2dt'idti 



Using the equations (|27-29) and representing A as a sum 
of the retarded and advanced parts we can simplify the 
action (^2|) and get the same result ( ^l|) as above. 

Scaling analysis of the equations (|27|-p9|) shows that 
their solutions have the following scales: A ~ r^, g r 
and D ~ ■ Using these values to estimate the 

last (quadratic in D) term in ( ^T| ) we see that it scales 
as /('''(^)^)^T^(ii* oc whereas the first two terms 
(and the action itself scale as J {T{j^))^dt 



oc T 



and 

I ''"(^)'''(^)^'''^^'^ °^ These estimates allow us to ne- 



glect the last terms in the expressions (31) and (p2[ ) for 
the action and the last terms in the equations ( |28[ ) and 

We were not able to guess the ansatz for the analytical 
solution of the equations ( p7| - ^ ). Instead we show nu- 
merically that the solution that we expected on physical 
grounds indeed exists. As explained above, we expect 
that as the temperature is decreased a given metastable 
state continues to subdivide and that the barriers be- 
tween these filial states are smaller than the barriers 
separating the ancestor states. Therefore we expected 
that a rare fluctuation ( "instanton" ) might take the sys- 
tem from one of these filial states to another leaving the 
ancestor state unchanged. In this case the memory of 
the perturbation applied at the times when these filial 
states were formed is completely lost, i.e. At^^f^ — for 
t2 greater than some i*. Indeed, we observe a solution 
with this property; in Fig 2a we show Af^^t^ obtained 



numerically for the slow cooling process which leads to 
the final reduced temperature = 0.1. This numerical 
solution clearly has the property that the memory of the 
latest perturbation is erased. Note also that the conju- 
gate field corresponding to this solution is small: it is 
proportional to r and moreover seems to have a numer- 
ically small coefficient. This solution corresponds to the 
action S/N « O.lr^. By construction this solution is not 
time-invariant, instead it is localized at the end of the 
cooling procedure. We expect that these equations also 
admit a solution of a different kind which occurs when 
the system is first slowly cooled down to the final tem- 
perature, ritf) = Tf^ and then kept at this temperature 
for a long time. This solution corresponds to a transition 
over the barrier at some tt, in this solution Atj^f^ = 
for < t2 < tf and U < ti. Such a solution should 
be invariant under a shift of t2, but, unfortunately, we 
could not study such solutions numerically because of 
a much larger number of time points required for such 
study. We expect that solutions with ~^ tf corre- 
spond to the transition between the states on the lowest 
level of the hierarchy and erase only a memory of the 
events in the narrow time range (t*, ij) when this hierar- 
chy was formed; from (^) it is clear that such solutions 
have very small action (suppressed by additional power 
of (r* — T/)^), so there is no lower bound on the energy 
of the barrier in this approach. This low bound might 
appear when terms of next order in 1 /N are taken into 
account and it is quite probable that the numerical result 
pl| that the lowest barriers scale with 1/A^^/^ is due to 
this mechanism. 

In conclusion we have developed the formalism which 
allows one to study the distribution of barriers in a spin 
glass with a large but finite number of spins, TV. We 
considered the particular example of the Sherrington- 
Kirkpatrick model and derived analytically the equations 
for the dynamic order parameters of this model that ad- 
mit transition over the barriers. We also showed numer- 
ically that these equations admit a non-trivial solution 
for which the energy of the barrier scales as Nt^ . It re- 
mains an open question whether this solution is unique or 
in fact these equations admit a whole family of solutions 
and the energy of the barriers has a broad distribution. It 
also remains to be investigated whether these results and 
general approach can be applied to the common phys- 
ical situation of a spin glass where each spin has finite 
number of neighbours but the total number of spins is 
infinite. 
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Fig. 1 Diagrams giving equations ( |2l[ - p6[ ). Here the lines with 
the arrows in the same direction denote G, the lines with arrows 
pointing outwards denote D and the lines with arrows pointing 
inwards denote D. Thick lines are full (renormalized) correlation 
functions, a thin line with arrows in the same direction is a bare 
Green function Go, a gray thick line is G i.e. the response func- 
tion calculated in the zeroth order in D, a gray circle denotes /3 
and a gray diamond denotes a four spin vertex, ^/y.The geomet- 
ric series for G is shown in (a) and (b); this series sums to ( |22| ) 
which is equivalent to the well known dynamical equations. 

First order corrections to G are shown in (c); as is clear from this 
series a general diagram contains 0, 1, . . . bare Green functions to 
the right of Dq and 0, 1, . . . between D and Dq so the sum of these 
terms is GGq^ (Gq ^G) making the sum of all diagrams linear in 
DGTIG^ DG with IT that is given by {^). In (d) we show the lead- 
ing terms in the expansion for D, this series is similar to the one 
shown in (c) and gives GIIGt. In (e) we show one term which gives 
the first order correction to D; this term is proportional to and 
together with the analogous terms that are proportional to DDq 
or Dl it gives GnGtBcnGt. Finally, in (f) and (g) we show the 
leading and subleading terms for D; note that the leading term for 
this function does not contain a bare part and moreover its self- 
energy contains either D or two response functions with opposite 
directions ensuring that the usual solution (in which D = and 
response is purely retarded) is self-consistent. 



Fig. 2 A numerical solution of the system of equations ( |27| - |29[ ) 
for the slow cooling process leading to the final reduced tempera- 
ture T{tf) = Tf = 0.1. All displayed functions are scaled by Tf. 
Fig 2a shows A, Fig 2b shows D and Fig. 2c shows D. From Fig 
2a it is clear that in this solution a perturbation applied during the 
later part of the cooling process, ttr < t < tf has no effect on the 
state at f J , so this solution corresponds to the transition that erases 
memory of these times; we also observe that this transition has rel- 
atively little effect on the correlation function D but results in the 
appearance of the 'noise' field D localized around times t ttr- 
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